A multi-modal event detection system for river and coastal marine monitoring applications

Abstract—This work is investigating the use of a multi-modal sensor network where visual sensors such as cameras and satellite imagers, along with context information can be used to complement and enhance the usefulness of a traditional in-situ sensor network in measuring and tracking some feature of a river or coastal location. This paper focuses on our work in relation to the use of an off the shelf camera as part of a multi-modal sensor network for monitoring a river environment. It outlines our results in relation to the estimation of water level using a visual sensor. It also outlines the benefits of a multi-modal sensor network for marine environmental monitoring and how this can lead to a smarter, more efficient sensing network

Investigation into the use of satellite remote sensing data products as part of a multi-modal marine environmental monitoring network

In this paper it is investigated how conventional in-situ sensor networks can be complemented by the satellite data streams available through numerous platforms orbiting the earth and the combined analyses products available through services such as MyOcean. Despite the numerous benefits associated with the use of satellite remote sensing data products, there are a number of limitations with their use in coastal zones. Here the ability of these data sources to provide contextual awareness, redundancy and increased efficiency to an in-situ sensor network is investigated. The potential use of a variety of chlorophyll and SST data products as additional data sources in the SmartBay monitoring network in Galway Bay, Ireland is analysed. The ultimate goal is to investigate the ability of these products to create a smarter marine monitoring network with increased efficiency. Overall it was found that while care needs to be taken in choosing these products, there was extremely promising performance from a number of these products that would be suitable in the context of a number of applications especially in relation to SST. It was more difficult to come to conclusive results for the chlorophyll analysis

Integrating multiple sensor modalities for environmental monitoring of marine locations

In this paper we present preliminary work on integrating visual sensing with the more traditional sensing modalities for marine locations. We have deployed visual sensing at one of the Smart Coast WSN sites in Ireland and have built a software platform for gathering and synchronizing all sensed data. We describe how the analysis of a range of different sensor modalities can reinforce readings from a given noisy, unreliable sensor

River water-level estimation using visual sensing

This paper reports our initial work on the extraction of en- vironmental information from images sampled from a camera deployed to monitor a river environment. It demonstrates very promising results for the use of a visual sensor in a smart multi-modal sensor network

Pedestrian detection in uncontrolled environments using stereo and biometric information

A method for pedestrian detection from challenging real world outdoor scenes is presented in this paper. This technique is able to extract multiple pedestrians, of varying orientations and appearances, from a scene even when faced with large and multiple occlusions. The technique is also robust to changing background lighting conditions and effects, such as shadows. The technique applies an enhanced method from which reliable disparity information can be obtained even from untextured homogeneous areas within a scene. This is used in conjunction with ground plane estimation and biometric information,to obtain reliable pedestrian regions. These regions are robust to erroneous areas of disparity data and also to severe pedestrian occlusion, which often occurs in unconstrained scenarios

Robust pedestrian detection and tracking in crowded scenes

In this paper, a robust computer vision approach to detecting and tracking pedestrians in unconstrained crowded scenes is presented. Pedestrian detection is performed via a 3D clustering process within a region-growing framework. The clustering process avoids using hard thresholds by using bio-metrically inspired constraints and a number of plan view statistics. Pedestrian tracking is achieved by formulating the track matching process as a weighted bipartite graph and using a Weighted Maximum Cardinality Matching scheme. The approach is evaluated using both indoor and outdoor sequences, captured using a variety of different camera placements and orientations, that feature significant challenges in terms of the number of pedestrians present, their interactions and scene lighting conditions. The evaluation is performed against a manually generated groundtruth for all sequences. Results point to the extremely accurate performance of the proposed approach in all cases

Short-term rainfall nowcasting: using rainfall radar imaging

As one of the most useful sources of quantitative precipitation measurement, rainfall radar analysis can be a very useful focus for research into developing methods for rainfall prediction. Because radar can estimate rainfall distribution over a wide range, it is thus very attractive for weather prediction over a large area. Short lead time rainfall prediction is often needed in meteorological and hydrological applications where accurate prediction of rainfall can help with flood relief, with agriculture and with event planning. A system of short-term rainfall prediction over Ireland using rainfall radar image processing is presented in this paper. As the only input, consecutive rainfall radar images are processed to predict the development of rainfall by means of morphological methods and movement extrapolation. The results of a series of experimental evaluations demonstrate the ability and efficiency of using our rainfall radar imaging in a nowcasting system

A framework for evaluating stereo-based pedestrian detection techniques

Automated pedestrian detection, counting, and tracking have received significant attention in the computer vision community of late. As such, a variety of techniques have been investigated using both traditional 2-D computer vision techniques and, more recently, 3-D stereo information. However, to date, a quantitative assessment of the performance of stereo-based pedestrian detection has been problematic, mainly due to the lack of standard stereo-based test data and an agreed methodology for carrying out the evaluation. This has forced researchers into making subjective comparisons between competing approaches. In this paper, we propose a framework for the quantitative evaluation of a short-baseline stereo-based pedestrian detection system. We provide freely available synthetic and real-world test data and recommend a set of evaluation metrics. This allows researchers to benchmark systems, not only with respect to other stereo-based approaches, but also with more traditional 2-D approaches. In order to illustrate its usefulness, we demonstrate the application of this framework to evaluate our own recently proposed technique for pedestrian detection and tracking

Event detection in pedestrian detection and tracking applications

In this paper, we present a system framework for event detection in pedestrian and tracking applications. The system is built upon a robust computer vision approach to detecting and tracking pedestrians in unconstrained crowded scenes. Upon this framework we propose a pedestrian indexing scheme and suite of tools for detecting events or retrieving data from a given scenario

FPGA-based conformance testing and system prototyping of an MPEG-4 SA-DCT hardware accelerator

Two FPGA implementations of a shape adaptive discrete cosine transform (SA-DCT) accelerator are presented in this paper: one PCI-based and the other AMBA-based. The former is used for conformance testing with the MPEG-4 standard requirements. The latter is an alternative platform for system prototyping and has an architecture more representative of a mobile device. The proposed accelerator meets real time constraints on both platforms with a gate count of approximately 40k, and outperforms the optimised reference software implementation by 20/spl times/. It is estimated that the accelerator consumes 250mW on a Virtex-E FPGA and 79mW on a Virtex-II FPGA in the worst case scenario